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ABSTRACT 

Although  nano-  and  microfabrication  techniques  are  rapidly  advancing,  it  remains  a  challenge  to  fabricate  separate  individual  microscale 
actuators  and  sensors  en  masse.  A  possible  resource  for  such  tiny  elements  exists  within  microorganisms.  Specifically,  the  abilities  of 
bacteria  to  move  in  a  self-propelled  manner  and  to  detect  and  process  sensory  information  represent  enormous  potential  that  can  be 
harnessed  and  integrated  into  microscale  robotics  and  biosensor  systems.  The  objective  of  the  proposed  program  is  to  develop  a  platform  that 
integrates  bacteria  with  enhanced  motility  and  signaling  behavior  (through  synthetic  biology)  into  a  microscale  sensing  and  robotic  system. 
The  platform,  termed  microbiorobots  (MBRs),  consists  of  controllable,  reconfigurable  elements  of  a  microscale  sensing  and  transportation 
network  in  biofactory-on-a-chip  systems.  The  goal  of  this  collaborative  proposal,  initiated  at  Drexel  University  with  the  participation  of 
Rensselaer  Polytechnic  Institute,  is  to  use  multiple  types  of  bacteria,  which  can  be  roughly  categorized  into  two  functional  types, 
propulsion/actuation  and  sensing/computation,  to  enhance  the  capabilities  of  existing  microrobots  through  localized  sensing  and 
computation.  In  pursuit  of  this  goal,  we  use  synthetic  biology  to  engineer  microbes  capable  of  sensing  chemicals  or  other  environmental  cues 
and  tuning  their  motility.  In  addition  we  use  intercellular  communication  to  further  coordinate  the  microbial  populations.  The  use  of  bacteria 
as  bio-info-micro  systems  represents  a  critical  step  toward  both  how  microbiorobotics  can  be  introduced  as  a  tool  in  nano/microscale 
engineering  work  as  well  as  how  scientists  and  engineers  can  learn  from  nature  using  modem  fabrication,  genetic  manipulation,  and 
deterministic  and  stochastic  modeling  and  control.  This  platform  will  be  applicable  in  microscale  assembly  systems  and  biosensors  that 
require  autonomous  coordination  of  bacteria. 
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Prof.  Kim  has  been  selected  to  receive  the  prestigious  2016  Netexplo  Award  for  his  work  with  micro-swimmer  robots.  Since 
2008,  based  on  a  panel  vote  participated  in  by  over  200  experts  and  business  professionals  from  around  the  world,  UNESCO 
and  Netexplo  have  announced  annually  the  Netexplo  100,  a  selection  of  the  100  most  promising  digital  initiatives.  From 
these,  the  ten  most  exceptional,  innovative  and  promising  projects  are  selected  as  award  winners  and  presented  at  the 
Netexplo  Forum  in  Paris.  From  these  ten,  a  final  Grand  Prix  2016  award  is  selected. 

Netexplo  is  an  independent  observatory  that  studies  the  impact  of  digital  technology  on  society  and  business.  Created  in 
2007  by  Martine  Bidegain  and  Thierry  Happe  in  partnership  with  the  French  Senate  and  the  French  Ministry  for  the  Digital 
Economy,  Netexplo  takes  a  unique  approach  to  understanding  digital  society.  Through  its  International  University  Network, 
the  Netexplo  Observatory  scans  the  world  for  the  new  faces  of  tech  and  their  inventions.  The  founding  partners,  the  Senate, 
the  Ministry  for  the  Digital  Economy  and  HEC  Paris  business  school  share  with  Netexplo  a  commitment  to  covering  every 
aspect  of  digital  innovation,  whether  technological,  commercial,  organizational,  social  or  environmental. 

Dr.  Kim’s  research  is  with  tiny  swarming  robots  that  have  the  potential  of  swimming  through  a  person’s  arteries  to  detect 
and  clear  blockages  or  to  deliver  a  drug  to  a  precise  area  of  the  body.  As  an  award  winner,  he  presents  his  work  on  February 
10,  2016  at  Paris-Dauphine  University,  Paris. 
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Scientific  Progress 

We  have  successfully  developed  a  platform  that  integrates  bacteria  with  enhanced  motility  and  signaling  behavior  into  a 
microscale  sensing  and  robotic  system.  The  platform,  termed  microbiorobots  (MBRs),  consists  of  controllable,  reconfigurable 
elements  of  a  microscale  sensing  and  transportation  network  in  biofactory-on-a-chip  systems.  Physically,  our  MBRs  are 
fabricated  microscale  chips  with  bacterial  cells  attached  to  their  surface.  The  MBRs  are  made  of  materials  with  neutral 
buoyancy,  thus  enabling  us  to  suspend  them  in  a  fluidic  working  environment. 

1 .  We  use  synthetic  biology  to  harness  and  improve  not  only  the  motility  behavior  of  the  bacteria,  but  also  their  sensory, 
biochemical  signaling,  and  information  processing  capabilities. 

2.  By  integrating  these  capabilities  with  the  motility  behavior  of  the  bacteria,  we  can  achieve  autonomous  coordination  of  the 
microbiorobots,  without  external  signaling  mechanisms.  Therefore,  our  proposed  system  is  controllable  in  the 
conventional  way  (i.e.  by  using  external  signaling),  as  well  as  through  local,  internal  signaling  or  autonomous  coordination. 

We  have  used  multiple  types  of  bacteria  that  can  be  roughly  categorized  into  two  functional  types,  propulsion/actuation  and 
sensing/computation.  In  pursuit  of  this  goal,  we  have  developed  synthetic  biology  to  engineer  microbes  capable  of  sensing 
chemicals  or  other  environmental  cues  and  tuning  their  motility.  In  addition,  we  have  used  intercellular  communication  to  further 
coordinate  the  microbial  populations.  The  use  of  synthetic  biology  allows  us  to  build  systems  that  can  be  easily  tuned  and 
manipulated,  providing  an  experimental  system  where  we  have  the  unique  ability  to  adjust  a  variety  of  parameters.  The 
propulsion/actuation  functionality  is  provided  by  swimming,  flagellated  bacteria  that  deliver  propulsive  forces  for  the  MBRs.  The 
sensing/computation  functionality  is  provided  by  genetically  engineering  bacteria  cells  that  contain  novel  synthetic  genetic 
networks  that  enable  them  to  sense  and  produce  various  types  of  small  signal  molecules.  These  small  signal  molecules  are 
used  as  tokens  of  information  that  can  be  processed  with  appropriate  synthetic  networks.  The  sensing  and  computation 
capabilities  of  the  bacteria  have  been  used  in  autonomous  coordination  of  the  MBRs  and  in  their  utilization  as  biosensors. 

Fundamental  scientific  progresses  addressed  by  this  research  program  include  (i)  the  use  of  synthetic  biology  in  hybrid 
microrobotics,  (ii)  obtaining  answers  to  basic  questions  regarding  methods  for  control  input  generation  using  external  stimuli 
that  lead  to  vision-based  feedback  control  of  MBRs,  (iii)  the  possibility  of  using  cell-cell  communication  for  coordinated, 
population  level  behaviors  to  achieve  biosensing  and  swarm  control  of  MBRs,  thus  enabling  an  entirely  new  class  of  sensing 
and  actuation  systems.  The  ability  to  complete  this  all  at  the  microscale  enables  the  realization  of  miniaturized  biofactories 
whose  applications  are  limited  only  by  our  imagination  but  include  in  vitro  procision  drug  delivery  and  chemical  sensors,  each  of 
which  has  its  own  needs.  Given  the  still  embryonic  state  of  microbiorobotics,  any  significant  progress  toward  the  control  of 
genetically  modified  engineered  bacteria  has  great  impact. 
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Motivation 


□  Technologic  Issues  for  Microrobotics 


Issues  for  the  advanced  task 

■S  Localization 
V  Navigation 

■f  Motion  control  for  specific  tasks 

Autonomous  navigation 

■S  Support  optimal  path 
■S  Prevent  damage  of  microrobot 
S  Save  time,  energy 
V Increase  efficiency 
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Reviews 


□ 


Autonomous  motion  control  for  navigation 

1.  Micromanipulation 


DavideJ  2011 

2.  Optical  Tweezer 


•  Microassembly  test  result  using  A* 


#KWP3 

■■  f 

•  KWP2 

Vva  % 

1  VKljfP2 

a 

1  ►  1  h  1 

/•  ft  •  | 

•  4  i 

•  Cell  transportation  using  RRT 


3.  Magnetic  field  for  Rolling  microrobot 


Samuel  C.  2015 


•  Motion  planning  using  RRT 
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Objectives 


•  An  autonomous  navigation  algorithm  using  Bacteria  Powered 
Microrobots 

1.  Static  obstacle  avoidance 

2.  Dynamic  obstacle  avoidance 

•  Collision  with  static  obstacle  •  Collision  with  dynamic  obstacle 


•  Hydrodynamics  of  bacterial  carpet  under  boundary  effect 

1.  Visualize  the  flow  field  using  pPIV 

2.  Analyze  the  flow  field  with  bounded  and  unbounded  condition 
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Bacteria  Powered  Microrobots 


□  Introduction  of  Bacteria  Powered  Microrobots  (BPMs) 


■  Concept  of  BPM 

•  Flagellum  motor  •  Swimming  motion  of  bacteria  Characteristics  of  Bacteria  in  Swimming 


■S  3D  motion  in  fluids 
•S  3-5  peritrichous  flagella 
S  Flagella  bundle  when  all  motors  turn  CCW 
S  When  motors  turn  CW,  bacteria  tumble 
•S  Average  swimming  velocity:  12  -  50  pm/s 
S  Random  walk 

•  Example  of  BPM 


•  Self-actuation  of  BPM 


S  Local  fluid  flow  motion 
S  Large  global  coordination  due  to  hydrodynamic 
interaction 

S  A  net  thrust  on  the  microsturcture  causing 
rotational  and/or  translational  movement 


Inorganic  body  (SU-8  structure) 

Biomolecular  actuator  of  bacterial  carpet 
0 Serratia  marcescens) 

Collective  Motion  of  Flagella 


Kim  2009 
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Bacteria  Powered  Microrobots 


m 


□  Fabrication  of  Bacteria  Powered  Microrobots 


•  Fabrication  of  microstructure 


□  □  □  □  □  □ 
□  □  □’;□  □  □  □  □  □ 

□  □  qjjp  □'□□do 

□  □□□□□.□□□ 

□  □  u  c  n  □  □  □  □ 

□  □  □  □)□  □  □  □  □ 

o  P'D  □  □  □  □ 
□  □  □  □■□□□□□ 
t  □  G  n  Q  □  Q 


•  Release  microstructure  by  Dextran  layer  •  Swarming  agar  plate  (  Serratia  marcescens  ) 


Bacteria 


Glass 


•  Scheme  of  a  BPM  •  Electrophoretic  control 


Advantage  of  biological  microrobots 

■f  Draw  energy  from  fluid 
■S  Easily  manufactured 

S  Self-coordinated  (quorum  sensing  or  hydrodynamics) 
•S  Fully  controllable  due  to  negative  charge  in  body 
S  Adjust  orientation  of  microrobots 
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I  Hydrodynamics  of  Bacterial  carpet 


□  Propulsive  force  by  bacterial  carpet 

1.  System  setup 


■  pPIV  setup 

o  Laser  :  633  nm  He-Ne  laser 
o  Fluorescent  bead  size  :  0.2pm  diameter 
o  Camera  :  High  speed  camera  250  fps 
o  Objective  lens  :  100  x 

■  Tethered  structure 

o  Dimension  :  32  x  34  pm2 
o  Thickness  :  35  pm  using  SU-8  2035 

■  Untethered  structure  (BPM) 
o  Dimension  :  32  x  34  pm2 

o  Thickness  :  3  pm  using  SU-8  2002 

■  Observed  planes 

o  Untethered  case  :  12  planes  (0~22  pm) 
o  Tethered  case  :  1  plane  (1  pm ) 


•*  m  m  •  *  Vflww  'vjJ 

4  *  *  «  •  •  A. 

f  *  •  *  4  •  *  * 

22  gm 

„  .  •••••.  * 

*  •  *  •  •  •  *  .  V?IWw«ii 

•  „  ,  •  .  «  «b«d 

#  •  ,  •  •  • 

. . 

LflL 

100  • 

•  Tethered  structure 


•  Untethered  structure(Self-actuation  of  BPM) 


•  Untethered  case 


I  Hydrodynamics  of  Bacterial  carpet 


□  Propulsive  force  by  bacterial  carpet 


2.  Experimental  results  :  Tethered  structure  cases 


•  Flow  field  tethered  structure  (at  6  pm  height  from  bacterial  carpet) 


■  Results  summary 

>  There  are  variance  on  Brownian  motion  due  to  measurement  noise. 

>  The  bacterial  carpet  generates  much  stronger  flow  field  than  Brownian  motion. 

>  The  strongest  flow  is  generated  at  6~8  pm  height  from  the  bacterial  carpet. 

>  The  flow  field  is  not  decreasing  dramatically  like  ‘Dalton  paper’. 

>  The  bounded  condition  (less  than  80  pm  distance  with  boundary)  affect  the  flow  fields  on  more  than  12  pm  height. 
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I  Hydrodynamics  of  Bacterial  carpet 


□  Propulsive  force  by  bacterial  carpet 


3.  Experimental  results  :  Untethered  structure  cases 


•  Untethered  structure(Self-actuation  of  BPM) 


■  Results  summary 

>  The  bacterial  carpet  was  close  to  wall  and  boundary  effects  on  the  flagella-induced  flow  field  must  be  taken  into  account. 

>  The  bacteria  secreted  lubrication  layer,  a  thin  layer  of  liquid,  approximately  1  pm  in  depth,  separates  the  bacterial  carpet 
from  the  glass  substrate. 

>  The  strong  velocity  flow  profile  was  observed  above  the  middle  of  the  moving  BPM. 

>  The  strong  streams  of  flow  were  much  stronger  in  the  moving  BPM  than  the  same  area  on  the  static  structure  surface. 

>  The  MSD  of  the  untethered  BPM  is  larger  than  the  tethered  cases  by  36.3  pm2. 
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I  Hydrodynamics  of  Bacterial  carpet 


□  Propulsive  force  by  bacterial  carpet 


4.  Comparison  of  ensemble  velocity 


Average 

std 

Tethered 

10.2  pm/s 

5.3 

Untethered 

20  pm/s 

10.4 

■  Results  summary 


>  The  effect  of  the  fluid  near-boundary 
leads  to  the  increase  of  the  resistance 
coefficients  in  terms  of  normal  and 
longitudinal  resistance. 


•  Ensemble  Average  Velocity 


Ensemble  motion 


Accumulation  of  displacement 


14 


CONTENTS 


I.  Introduction 

•  Motivation 

•  Reviews 

•  Objective 

II.  Research  works 

•  Hydrodynamics  of  Bacterial  carpet  using  pPIV 

•  Static  Obstacle  Avoidance  for  Bacteria  Powered  Microrobots 

•  Dynamic  Obstacle  Avoidance  for  Bacteria  Powered  Microrobots 

III.  Conclusion 

IV.  Future  Works 

V.  Achievements 


15 


II  Static  Obstacle  Avoidance 


□  Constraint  elements  for  obstacle  avoidance  using  BPMs 

1.  Self-actuation  of  BMPs 

■  Uncontrollable  motion 

High  probability  of  collision  risk 

V  Inherent  motion  of  BPMs  caused  by  bacterial  carpets 

V  Uncontrollable  motion  by  electric  fields 

V  The  resultant  locomotion  by  self-actuation  and  electrophoretic  motion 


•  Collision  with  obstacle 


■  Kinematic  model  of  self-actuation  BMP 


•  Coordinate  system 
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II  Static  Obstacle  Avoidance 


□  Constraint  elements  for  obstacle  avoidance  using  BPMs 

1.  Self-actuation  of  BMPs 

■  Global  coordinate  system  for  position  of  BPMs 


Vgx  =  VxcosQ  —  VySinO 
Vgy  =  VxsinO  +  VyCosO 


Adx—  f?4.Ux 

Ady=  P^Uy 


where,  Vx  =  p/?4 ,  Vy=  p/?2,  a  =  p/?3,  /?4  :  Electrophoretic  property 

p  :  mean  propulsive  force  (0.4 lpN). 


■  Kinematic  model  of  BMP’s  locomotion 

Pi  Pi-1  "f  L0C017l0ti0Ylseif-actuation  +  L0C0Ytl0ti0Yleiectroi<inetic 


(Xl\ 

/xt- 1\  ! 

'cos6i-1 

—sinOi-x 

O’ 

pi 

M 

ii 

Vi 

+ 

'tii 

sinQi-i 

cos6i-1 

0 

Pz 

ts 

w 

VW  i 

0 

0 

a. 

Pz 

Unit: 


am 

Pl  P2  spN 


rad 

B3: - , 

spN 


pm 

'  sVcm  1 7 


II  Static  Obstacle  Avoidance 


□  Constraint  elements  for  obstacle  avoidance  using  BPMs 


2.  Reliability  of  kinematic  model 


■  Modeling  Validation  using  40  x  43  pm2 


«  0.16  sec  1  12, 

0.16  sec 

_ Error  distance 

10- 

-Average  oterror 

.  #  13  }j 

— V — JM®  -  -V 

21 

40pm 

°° 

50  '100  '150  p  250  300  350  * 

100 

•  Self-actuation  •  Motion  with  +20  V/cm  (right  direction) 


■  Modeling  Validation  using  20  x  23  pm2 
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II  Static  Obstacle  Avoidance 


□  Constraint  elements  for  obstacle  avoidance  using  BPMs 

3.  Distorted  electric  field  around  obstacles 

■  Unmatched  movement  with  desired  motion 

o  COMSOL  Simulation  Setup  :  Particle  is  negative  charged  particle.  (  9.1  x  1017  kg,  -1.6021  x  1011  C  ), 

Obstacle  is  regarded  as  insulator,  Input  -  Anode  (Left),  Cathode  (Right)  with  10  V/cm 


•  Particle  motion  •  Result  of  Particle  trajectories  •  The  difference  of  heading  angle 


■  Simulation  Summary 

S  There  exist  zero  potential  area  around  the  obstacle  which  gives  non-mobility  to  the  particle. 
•S  The  deformed  electric  field  steers  the  particle  toward  the  distorted  angle.  (Maximum  3°) 

S  As  far  away  from  obstacles,  the  effect  of  distorted  electric  field  becomes  week. 


II  Static  Obstacle  Avoidance 


□  Constraint  elements  for  obstacle  avoidance  using  BPMs 

4.  The  effect  of  distorted  electric  field 


® 


:  Electric  field  direction 


A 

. 

/> 

\ 

O 

22©  o  • 

© 

20nm 

■  Demonstration  Result 

■S  BPM  cannot  move  at  zero  potential  area. 
S  BPM  follows  the  deformed  electric  field. 
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II  Static  Obstacle  Avoidance 


□  Constraint  elements  for  obstacle  avoidance  using  BPMs 

5.  Omnidirectional  motion  (holonomic  motion) 


•  Direction  of  electric  field 


•  Motion  example 


•  Displacement  ^  :  Magnitude  of  electric  field 


■  Control  characteristics 

S  The  direction  of  electric  field  results  from  x  voltage,  y  voltage  inputs. 

•S  The  magnitude  of  electric  field  is  proportional  to  the  sum  of  x  voltage,  y  voltage  inputs. 
•S  The  superposed  electric  field  can  be  a  range  of  0-360°. 

•S  The  maximum  resultant  control  input  is  20  V/cm  in  the  system. 


Kim  Group  2007 


II  Static  Obstacle  Avoidance 


tjy 


□  Proposed  Static  Obstacle  Avoidance  Approach 

1.  Obstacle  avoidance  approach  based  on  an  objective  function 

f{lJx,  Uy)  =  a  heading (lJx,  Uy,  Goal)  +  y  movement(Ux,  Uy)  +  co  clear ance(Ux,  Uy)  +  S  control(Ux,  Uy) 

1)  heading( )  :  to  choose  the  input  which  makes  BPM  head  to  the  goal 

2)  movement( )  :  to  choose  the  input  which  makes  BPM  move  a  longer  displacement 

3)  clearance ( )  :  to  avoid  the  input  which  makes  BPM  collide  to  obstacles 

4)  control ( )  :  to  choose  the  input  which  makes  BPM  move  toward  strong  controllable  area 


■  The  procedure  to  choose  the  control  input  from  the  objective  function 

1.  Consider  the  instant  position  of  a  BPM  with  boundary  information 

2.  Calculate  each  function  of  the  objective  function  depending  on  all  admissible  control  inputs 

3.  Find  an  optimal  control  input  which  has  the  maximum  cost  of  the  objective  function 


II  Static  Obstacle  Avoidance 


□  Proposed  Static  Obstacle  Avoidance  Approach 

2.  heading  function 

heading(Ux,  Uy,  Goal )  =  ^  h-  n 


(a)  (b) 


•  Situation  of  a  BPM  and  Goal  •  Resultant  cost 


3.  movement  function 

movement{U x,  Uy )  =  /?4 tsy/Ux2  +  Uy2 


II  Static  Obstacle  Avoidance 


□  Proposed  Static  Obstacle  Avoidance  Approach 

4.  clearance  function 


•  Map  (500  pm  x500  pm) 


•  C-space  to  check  collision 


•  Resultant  cost 


II  Static  Obstacle  Avoidance 


□  Proposed  Static  Obstacle  Avoidance  Approach 

5.  control  function 


,  n  V  EF  ■  Input  (UYi,  Uvi) 

control(U x,  Uy)  =  g - ^ 


i  =6 


*  =7^{  bpmJ^B  ^=3 
^i=4 


i  =5 


•  At  the  next  position 


x(pm) 


Obstacle 


Area  2 


•  Intrinsic  potential  field 


•  Resultant  cost 
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II  Static  Obstacle  Avoidance 


□  Proposed  Static  Obstacle  Avoidance  Approach 

6.  The  chosen  input  from  total  value  of  the  objective  function 


f(Ux,  Uy )  =  a  heading(Ux,  Uy,  Goal)  +  y  movement(Ux,  Uy)  +  a)  clear ance(Ux,  Uy)  +  S  control(Ux,  Uy) 


•  Result  of  the  objective  function 


■  Characteristic  of  the  objective  function 

S  Optimal  input  to  maximize  the  cost  of  objective  function  depending  on  weight  values  of  a,  y,  co,  6. 


II  Static  Obstacle  Avoidance 


□  Experimental  Results 


1.  System  setup 

■  Obstacle  structures 

o  Material :  SU-8  2010 
o  Height :  20  |im 

■  BPMs 

o  Material :  SU-8  2002 
o  Shape  :  32  x  30  pm2 
o  Height :  3  pm 

■  Control  System 

o  0.16  sampling  time 
o  C++ programming 
o  GUI  interface 

■  Experiment  Chamber 
o  Material :  PDMS 

o  Filled  with  PBS  buffer 
o  Two  pairs  of  platinum  wire 


Image 

acquisition 


► 


Control  System 


II  Static  Obstacle  Avoidance 


□  Experimental  Results 

2.  Single  obstacle  avoidance  with  simulation  result 


Drexel  Univ  Bast  Lab 


Goal  position  r  “i 


■  Simulation  Result 

(  +  Real  Experimental  Result 


t.2  tl 


>  One  obstacle  environment  (71  x  74  pm2) 

>  Maximum  Voltage  input:  20  V/cm 

>  Parameters  for  algorithm 


r 

S 

ft 

ft 

ft 

A, 

0.25 

0.3 

0.5 

0.5 

0.01 

0.03 

0.01 

0.32 
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II  Static  Obstacle  Avoidance 


□  Experimental  Results 


3.  Two  obstacles  avoidance  with  simulation  result 


>  Two  obstacles  environment 

(71  x  74  jam2  and  52  x  57  jam2) 

>  Maximum  Voltage  input:  20  V/cm 

>  Parameters  for  algorithm 


- 

7 

®  * 

A 

a 

A 

0.5 

0.4 

0.8  0.41 

0.1 

0.02 

0.01 

0.14 
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II  Static  Obstacle  Avoidance 


□  Experimental  Results 

4.  Routing  motion  with  different  weight  values 


G 

. 

G 

Goal  position 

A 

n 

Goal  position 

A 

R 

0 

R 

20pm 

i 

20pm 

13 

C heading  :  0.4,  movement :  0.3,  clearance:  0.6,  control  :  0.55)  ( heading  :  0.45,  movement :  0.3,  clearance :  0.6,  control  :  0.7) 


Control  input 


•  Control  input 
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II  Static  Obstacle  Avoidance 


□  Experimental  Results 

5.  Routing  motion  with  different  weight  values  II 


9 

o 

s 

Goal  position 

A 

Goal  position  _ 

*  n 

0 

o 

n 

0 

20pm 

20pm 

ii 

(heading  0.45  movement :  0.41,  clearance:  0.6,  control  :  0.61)  (heading  ■  0 .45,  movement:  0.41,  clear ance:  0.6,  control  ■  0.55) 


(a) 


f  c  A5 


(b)  •  a  0  45.7  - 0.41. •- 0.6.6  055 

♦  a  -  0  45,  y  -  0.3.  at  -  0  6 .  &  -  0  7 


0 


.  n  - 

^t-77*  n 

Goal  fj  •  a -0.45,7-0.41, ««0.6. 6-0.61 

♦  a  =  04,  y  =  0  3,  w  =  0.6 . 5  =  0.55 


•  Comparison  of  trajectories 
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II  Static  Obstacle  Avoidance 


□  Experimental  Results 

6.  Routing  motion  in  Multiple  obstacles  with  different  weight  values 


o  o 


•  Comparison  of  trajectories 
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II  Static  Obstacle  Avoidance 


□  Experimental  Results 


7.  Other  Multiple  obstacles  avoidance  results 

Goal  position 


o 

u 

Goal  position 

A 

o  O 

o 
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o 

• 

c S 
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o 
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o  [^)  O 
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Summary  of  experimental  results 


|  Total  Exp.  No  | 

Success  rate 

One  obstacle 

N/A 

3 

100% 

Two  obstacles 

60 

3 

100% 

Three  obstacles 

50 

10 

100% 

Multiple  obstacles 

30 

18 

88% 

V  The  feasibility  of  the  algorithm  is  verified  with  different  conditions  and  various  BPMs. 
S  The  trajectories  result  from  the  different  weighting  a,/,co,S. 

S  Most  cases  have  applied  BPMs  with  the  maximum  control  input  voltage. 
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Ill  Dynamic  Obstacle  Avoidance 


□  Constraint  elements  for  obstacle  avoidance  using  BPMs 

1.  Distorted  electric  field  around  dynamic  obstacles  :  undesired  control  result 

■  Undesired  control  result 


•  COMSOL  simulation  results 


•  Distorted  electric  field  •  Profile  of  Distorted  electric  field 


■  Simulation  Summary 

S  The  distorted  electric  field  area  forms  a  ripple  formation  from  the  obstacle. 
■S  The  back  side  of  the  object  has  more  ununiformed  electric  potential  field. 
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III  Dynamic  Obstacle  Avoidance 


m 


□  Constraint  elements  for  obstacle  avoidance  using  BPMs 


2.  Unexpected  motion  speed  of  dynamic  obstacle 


Ill  Dynamic  Obstacle  Avoidance 


□  Proposed  Dynamic  Obstacle  Avoidance  Approach 

1.  Supplementary  VFH  method  to  the  static  obstacle  avoidance  approach 


Procedure  to  choose  the  optimal  control  input 

Step  1  :  Exclude  the  control  inputs  which  heads  to  obstacles  using  the  redefined  VFH  (v(U,  6)) 


0V  —  {9i}  for  BD(6i)  <  safe  range,  1  <  i  <  360 
Te  =  min(|0  -  0V |) 

f  0  ifTg  <  £s  'j 

v(U,e)  =  \-£-  if  es  <  Tg  <  Tmax  [ 

|  lmax  1 

V  1  if  Tmax  ^  Tq  J 


Step  2  :  Find  the  optimal  control  input  using  objective  function  on  remained  candidate  inputs 


II  Dynamic  Obstacle  Avoidance 


□  Proposed  Dynamic  Obstacle  Avoidance  Approach 

2.  Simulation  of  the  proposed  approach  using  MATLAB 


Ill  Dynamic  Obstacle  Avoidance 


□  Proposed  Dynamic  Obstacle  Avoidance  Approach 

3.  Evaluation  of  performance  in  terms  of  potential  risk 

Danger  Index  :  gD(PB0 ) 1  9a<Aco) 

>  Product  method  based  criterion 

1st  Factor  :  The  relative  distance  factor  between  BPM  and  dynamic  obstacle 


Dbo  ■  the  distance  between  the  BPM  and  the  obstacle 

I  0  :  Dbo  >  Dmax  \ 

9d iP bo)  z 

^Dbo 


where,  k  =  - 


maximum  allowable  distacne  between  the  BPM  and  the  obstacle  ( safe  range ) 


Dmin  =  Radius BPM  *  kv  +  Movement seif  ,  kv  = 


_  " mean  of  dynamic  obstalce 


V-mean  of  BPM 


2nd  Factor  :  The  relative  angle  of  control  input  comparing  to  the  angle  toward  the  dynamic  obstacles 

Aco  :  the  angle  gap  between  the  control  input  and  the  heading  angel  from  BPM  to  the  obstacle 

0  ’  Aco  ^■^blOCkAngiPBo)/2^'Qbyself-aCtUati0n\ 

Aco  <'  ^blockAngiPBo) /2  +  6  by  self -actuation 


9a(AC0 )  — 


Aco 


I  DblockAng(PBo)/2+Qby self  -actuation 

where,  DbiockAng{DBO)  =  the  angle  that  represents  occupied  angle  by  obstacle  depending  on  Dbo 
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III  Dynamic  Obstacle  Avoidance 


□  Experimental  Results 

1.  System  setup 


■  Dynamic  obstacle  structures 


o  Material :  SU-8  2010 
o  Thickness  :3pm 
o  Nickel  deposition  :  200  nm 


—  Nickel 

I  I  SU* 

I  |  Orxtran 


z-coil  to  overcome  friction 
o  Lift  force  :  1.5mT  (2V) 
o  Tilt  the  structure 


Control  System  for  main  algorithm 
o  0.16  sampling  time 
o  C++  programming 
o  GUI  interface  to  input  goal  position 


Control  System  for  dynamic  obstacle 
o  0.16  sampling  time 
o  C++  programming 
o  GUI  interface  for  manual  control 
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Ill  Dynamic  Obstacle  Avoidance 


□  Experimental  Results 

2.  Magnetotaxis  test  on  BPMs  w/wo  electric  fields 

■  Setup  :  Magnetic  field  for  more  than  2  min  with  20  Voltage  input 


■  Magnetotaxis  test  results 

V  In  terms  of  self-actuation,  there  is  not  critical  difference  with/without 
magnetic  fields.. 

V  The  motion  control  of  BPMs  is  not  affected  by  the  magnetic  fields. 

V  It  is  not  a  problem  with  the  application  of  magnetic  fields  for  dynamic 
obstacles. 
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III  Dynamic  Obstacle  Avoidance 


□  Experimental  Results 

3.  Single  dynamic  obstacle  avoidance 
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Ill  Dynamic  Obstacle  Avoidance 


□  Experimental  Results 

4.  Danger  index  for  single  dynamic  obstacle  avoidance  experiments 

■  Example  using  Case  II 


*  Dynamic  obstacles 
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•  Resultant  trajectories 
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•  Danger  index  of  Case  I 

•  Danger  index  of  Case  III 

■  Danger  index  of  Case  IV 
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mean 
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I  9.6 
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30.3 
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III  Dynamic  Obstacle  Avoidance 


□  Experimental  Results 


5.  Single  dynamic  obstacle  avoidance  using  strong  seif-actuation  BPMs 

■  Case  V 


Ill  Dynamic  Obstacle  Avoidance 


□  Experimental  Results 

6.  Multi  dynamic  obstacle  avoidance 


•  Case  VII 


► 


<t> - To 


f 


Danger  Index  by  Dl 
Danger  Index  by  D2 


..  30  40  50 

time  (s) I 


Danger  index  of  Case  VII 


VII  0.3  0.4  0.6  0.5  120 

VIII  0.3  0.2  0.7  0.5  100 


Pi 

P3 

P4 

Mean  danger 

VII 

-1.89 

5.03 

0.01 

0.76 

0.15 

VIII 

5.01 

6.20 

0.08 

0.81 

0.02 

BPM 

Dynamic  obstacle  v 

V 

mean 

max 

VII 

10.9 

12.7 

116.1 

10.9  167.7 

VIII 

15.3 

14.3 

100.9 

21.7  180.9 

Summary  of  experimental  results 

v^The  feasibility  of  the  algorithm  is  verified 
with  various  situations. 

VThe  performance  is  evaluated  using  the 
danger  index. 
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□  Development  of  the  obstacle  avoidance  algorithm  for  BPMs 

>  Consideration  of  BPMs’  characteristics  and  control  systems  design 

>  Improvement  of  controllability  for  BPMs  using  electric  fields 

>  Robust  approach  for  static  and  dynamic  obstacle  avoidance 
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Future  works 


1.  Adaptive  parameters  self-calibration  for  robust  performance 

•  Probability  approach  -  Machine  learning,  Neural  network  algorithm 

•  Increase  of  flexibility  for  environment 

2.  Swarming  obstacle  avoidance  control 

•  Swarm  control  of  multiple  microrobots 

•  Centralized  control 

•  Improvement  of  accuracy  locomotion 
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